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ABSTRACT 

This paper describes a study in which ia linguistic 
variables were used to deterjmine which variablea would account for a 
significant amount of the observed variance in the error rate in 
verbal arithmetic problems. Three forms of verbal problem seta in 
which the number o± words in the problem statement were 
systematically varied were administered to clasaea of students in 
grades four through eight* Regression analysis showed that none of 
the variables accounted for a significant amount of variance for all 
grades^ although four variables did enter the regression within the 
first six steps on two or more of the test forms for most grades* 
Regression analysis on a selected subset of six variablea produced 
results similar to those provided by an analysis involving all 14 
original variables. (Author/DT) 
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Fourteen linguistic variables 5 defined in a previous studv, 
were used to determine which variables would account for a 
significant amount of the observed variance in the error rate 
in verbal arithrnatic problems. In this study ^ three forns of 
a verbal problem set in which the number of the words in the 
problem sratements were systematically varied were administered 
to classes of students in Grades 4-8* Using reeression 
analysis, none of the variables were found to account for 
a significant amount of -the variance for all grades, although 
four variables did onter the regression within the first 
six steps on two or more of the test forms for most grades. 
S-electing a subset of six variables 5 regression analysis 
produced results which were similar to those provided by 
the analysis involving all fourteen original variables. 
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Jerman" and Rees (19 72) and Jerman (19 7 3a, 1973b) 
investigated the influence of structural variables on the 
relative difficulty of verbal arithmetic problems for 
students in grades 4 - g (19 72, 19 73b) and in grades k - 8 
(1973a). Krushinski (1973) investigated the influence of 
certain linguistic variables on the relative difficulty of 
verbal arithmetic problems for college students enrolled in 
a methods of teaching elementary matnematics course. One 
purpose of this study was to determine the influence of 
the linguistic variables on the ability of students to 
solve verbal arithmetic problems in grades 4-8. A 
second purpose was to identify a small subset of the 
variables (no more than six) which could be used in further 
investigations. 

The data' from Jerman (19 7 3a) were used in this 
investigation, in that study, Jerman determined that aaveral 
structural variables which had accounted for a significant 
amount of the variance in the linear regression in his 
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• previous study C1973b) also accounted for a sicnificant amount 
of the variance in rhe more recent study (1973a). In addition, 
the nunber of words in the problen statement antered the 
regression in a few of the analyses but not all of uhem. 
Hence, Jerman suggested tnat it is not simply tne number of 
words in the problem statement that influence its difficultv, 
but the number of words in relation to other factors. Thus 
an attempt to determine these "other factors" was unaertaken. 
Krushinski C19 73) working with a sat of 14 linguistic 
variables found that the following six; sentence length, 
the number of clauses, clause length, the number of 
prepositional phrases, the number of words in the question 
sentence and the numeral in the question sentencw accounted 
for a significant amount of the variance in nis study with 
college. students. The fourteen linguistic variables used in 
the regression analysis in the present study were the sane 
as those used by Krushinski and were defined as follows: 

1. Length CLENGTii) was defined as the number of words 
in the problem statement. A count of one was 
assigned to a single word, hyphenated word, or 
group of words that would appear as a single entry 
in a dictionary. For example, P.M. was counted 
as 1. Also, numerals were converted to words and 
then counted. For example, $3.75 was assigned a 
count of 5 ($3.75 - three dollars and seventy-five 
cents ) . 



Sentences (SL':/T) was defined as the number of 
sentences in the problem. 

Sentence length (SE.fTLlO was defined as the average 
number of v/ords per sentence and was obtained by 
forming the ratio of variables 1 and 2 respectiyely 
LENGTH 

Main clauses (MAINCL) was defined as the number of 
main clauses in' the problem. 

Subordinate clauses (SU3CL) was defined as the 
number of subordinate clauses in the problem. 
Clauses CCLAUSE) was defined as the total number 
of clauses in the problem and was obtained by 
adding the values of variables if and 5: 
CLAUSE = MAINCL + SUBCL. 

Words in the main clauses C'iDMAIN) was defined 

as the number of words in the main clauses 

(identified by MAINCL) in the problem. 

v/ords in the subordinate clauses C'./DSUa) was defined 

as the number of words in the subordinate clauses ' 

(identified by SUB CD in the problem. 

Clause length (CLSUO was defined as the average 

number of words per clause. and was obtained by 

forming the ratio of variables 1 and 6 ■respectively : 

«T cTKr - LENGTH 

= CLAUSE • 



10, Main clause lenoth (MCL3LN) was defined as the 
average number of vJords per ir.ain clause and v/as 
obtained by forming the ratio of variables 7 and 
4 respectively I 

MCLSLN = ™§| . 

11, Subordinate clause length (SCLSLN) was defined as 

the average number of v/ords per subordinate clause 

and was obtained by forming the ratio of var-iables 

^8 and 5 respectively: 

WDSUB 
SCLSLN - er-irr . 

12, iVumber of prepositional phrases (PREPHPs) was 
defined as the number of prepositional phrases in 
the problem. 

13, Number of words in tiie question sentence CvDSilQ); 
one count was given for each word in the question 
sentence in the problem, 

14, Numeral in question sentence (NUMINO) was given a 
value of 1 if the question sentence contained 
numerals and a value of 0 otherwise t 

Method 

Three teat forms of 30 problems each were prepared 
using the problem set of 30 problems employed in the 
Jerman (1973b) study. Three types of each problem were 
prepared. Type 1 was the original proDlem net with one-third 
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fev/er words in each problem, Type 2 was the orioinal 
problem set. Type 3 containeci one-rhird more words in each 
problem than the original problem set* The digits in each 
problem^ the order of operations^ the cues, and all other 
structural suspects (as pertaining to the structural 
variables defined by Jernanj 197.3a) were held constant, 
however eKtra clauses and modifiers were added to Type 2 
problems to qualify them as Type 3 problems. Type 1 
problems v/ere obtained by elirninating words and phrases from 
Type 2 problems* Each of the three test forms contained 
30 problems; 10 of Type I5 10 of Type Z, and 10 of Type 3. 
V/hile the problems v/ere distributed among the three forms 
on a random basis t they were arranged in the same order on 
each test 5 from easy to more difficult on the basis of 
previous experience * 

In May 1971 , the problem sets v/ere administered to 
students by their classroom teachers. The three test forms 
were randomized prior to distributing them to the students. 
Students performed all their work on the test forms and 
were cbmpleted during their normal mathematics period whJ ch 
ranged from 40 to 50 minutes in length* All of the tests 
were scored by Jernan, 

Results 

The mean percentage GOrr€»ct and standard d-iviation 
for each class group are presented, in Table 1, For a 
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detailed discussion concerning the inpUoations of these 
figures and a statistical conparison of the means, the 
reader is referred to Jerman (1973a). For purposes of th: 
study, the focus is on the linguistic variables in a 
regression model. 



Insert Table 1 about here 



Tables 2, 3, and ^ present the number of each variable 
which entered at each step in the regression for each 
group for each of the three test forms. The multiple R 
for the sixth stop and the total R are also given. 



:"isert Tables 2,3,1+ about here 



Observing the tables, the two variables which entered within 
th« first several steps with the greatest frequency v;ere 
variables 8 CVDSUB) and 12 CPREPHR). In fact, the number 
of words in the subordinate clauses (>/DSUB) entered first 
in 9 of the^ 18 analyses. Also, the number of prepositional 
phrases CPREPHR) entered second in 9 of the IB regressions. 
In partioulari observing the totals columns. for each of 
the three forms reveals that variable 8, CV/DSUB) entered 
first, followed by variable 12 (PREPHR) for forms 2 and 3 
but neither variable entered the regression within the 
first six steps for Form 1, 
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The regresaion coefficients, standard errors of 
regression coefficients, and computed t-values' for each of 
the variables in the first six steps for each group are 
shown in Tables 6 and 7, 



Insert Tables 5^ S, 7 about here 



Variable 8 C\/DSUB) was significant for several of the groups 
who received Foi^m 3 of the Test but for only 1 group in 
each of Forms 1 and 2. Four other variables, 3 CSEMTL:!), 
S (SUBCL), 9 (CLSLN)'and 10 CMCLSLM) ware significant for 
two of the 18 analyses while 12 (PRKPHR) was significant 
for only 1 of ^the groups* Referring to the^^Total" column 
of Tables 5^ 6, and 7 v/hich shows the first six variables 
which entered the regression based on the mean percentage 
correct for all students, it is worth noting that only 
one variable, 3 CSEMTLN )5 ^ entered thf regression for all 
three forms of the test. 

Based on the regression analyses discussed above , 
an attempt was made to reduce the number of variables 
without sacrificing much of the variance accounted for by 
the fourteen variables. With a limit of six variables in 
mind 5 several analyses were performed which resulted in 
six variables being selected. These werei 3 (SEriTLN), 
5 (SUBCL), 8 CWDSUB), 9 (CLSLN), 12 (PREPHR) , and 
14 (NUMINQ), 
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Tables and 10 present the number of each of the 

six variables which entered at each step in the regresBion for 
each group for each of thy three test forms* The multiple R 
for the fourth step and the total R are also given* 



Insert Tables Oj 9, 10 about here 



Comparing the R's in Tables 8^ 9^ and 10 wixh those in 
Tables 2 5 3 , and 4, one observes that the difference betv/een 
the R at the Sixth step on Tables 2, 3^ and 4 and the 
total R on Tables 8, 9, and 10 exceeds *05 in only one 
instance (Grade 65 Form 1 where the difference, is ,104), 
The^ greatest discrepancies occur for Form 1 v/hile the fit 
for Forms 2 and 3 are quite similar. 

Tables 11 1 12 5 and 13 present the information for the 
six variables which corresponds to Tables 5 5 S, and 7 for 
the fourteen variables with the eKCeDtion that the 
coefficients that appear in Tables 11 3 12 ^ and 13. are for 
the final regression equations not the equation after 
Step 6 as is the case in Tables 5, 63 and 7. 



Insert Tables^ 11^ 125 13 about here 

With only the selected six variables in^ the regression 
analysis, four variables were significant for one or more 
of the groups. They were| 3 (SENTLN), S CSUBCDg 8 (WDSUB) 
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and 9 (CLSLiO. Observing the "Total" column in Tables 11, 
12s and 13, note tnat for Form l^ variables 0 and 12 
failed to enter the regression at all v;hile thev entered 
first and second respectively for both of the other test 
forms . 

Discussion 

Only two of the six variables v/hich Krushinski (19 73 ) 
found to be significant entered consistently anong the first 
slK in the linear regression in this study; these v;ere, 
9 CCLSUJ) and 12 (PREPHR) . CLSW v;as significant in 
only 3 of the 18 separate analyses while PRHPaR was 
significant only once* aince Krushinski 's study involved 
college students and the students in the present study were 
from grades ^ ^- b, the fact that two variables appear to 
be important in the regression analysis wirh both groups 
raises hopes that it is possible to find specific linruistic 
variables which can be shown to contribute to the 
difficulty of solving word problems for all students. 

Encouraging also, is that four variables: 3 CSENTLM) , 
8 (WDSUB), S CCLSLN), and 12 (PREP£IR)| entered the reoression 
consistently within the first sIk steps on two or more of 
the test forms* This result suggests that specific 
linguistic variables can be identified which will contribute 
to the difficulty level of verbal arithmetic problems on all 
teat forms. On the other hand, several variables used in this 
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study entered the regression consistently on only on- of the ' 

three test f orms • these were, variables SCjUiJCL), 10 (MCLGLI), 

and m (WUMIJQ) .on Forr.i 1 and variable 11 (3CLSL.I) on 

Form 2. The failure of these variables to contribute to 

the regression on mora than one test form sucaests that variabl 

other than those identified in this study influenced the 

difficulty level of the problems on the three test forms. 

_ Woticeably absent from being significant in the 
regression was the length variable CLLWGTIi). Earlier 
studies, (Jerman 1973a, 19 73b), found that the variable for 
the number of wor-',s in the problem statement v/as sisnificant. 
In the present study, the number of words was not 
significant. In fact, LEHRTH . entered among the first six 
variables on only five occasions — coming in no hifsher than 
step 3. Perhaps one of the explanations for the discrepancy 
in the results is tne fact that the definitions used were 
different. The definition used in this study" counted the 
word equivalent of numerals while the previous studies assifined 
a count of 1 to each numersil. This subtle difference coupled 
with the fact that NUMIMQ (numeral In the question sentence) 
appears to be an important variable suggests that more 
attention be paid to any numerals in ' the problem statement. 

Any broad generalizations based on the results of 
this study should be made with eKtreme caution for the 
simple reason .that the multiple R at the end of six steps 
for the m variables and the total R for six variables 
was .778 or less which indicates that the per cent of 



11 

variance acGOuntcd for by the variables included in the 
regression CR^) was 60% or less, ilence^ the linguistic 
variables identified in the present study do not account 
for as large a portion of the variance as would be necessary 
in order to attempt to accurately predict the difficult^ 
level of verbal problems. 
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■ TABLE 2 
Variables Entered at Kach Step 
for Form 1 of the Test 



STEP 


Grade 4 


Grade 5 


Grade 6 


Grade 7 


Grade 8 


I TOTAL 

i 


1 


10 


5 


10 


S 

1 


8 


5 


2 . 


5 


9 


5 


! 

10 


10 


10 


3 


14 


3 


12 


12 


3 


14 


1+ 


11 


14 


9 


3 


14 


. .'3 


5 


13 


13 


11 


6 


12 


7 


6 


'9 


7 


8 


14 


9 


1 


7 


8 


10 


13 


11 


11 


9 


8 


3 


■ 11 


■ 7 


9 


5 


11 


9 


5- 


1 


2 


8 


13 


13 


■ 10 


6 


2 


14 


2 


7 


2 


11 




12 . 


3 


7 


2 


4 


12 




5- 


6 


13 




12 


13 




4 










ST£P 6R 


, 458 


. 743 


.S53 


,630 


, 499 


,601 


TOTAL R 


.47S 


.797 


.675 


. 662 


. S57 


. 643 
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TABLE 3 

Variables Entered at Each Step 
for Form 2 of the Test 





J 


1 


i Grade 6 


1 

Grade ■ 7 


; Grade 0 


i TOTAL 
1 


1 


8 


12 


i 

s 


8 


, 8 . 


: 8 


2 


12 


11 


12 


12 


12 


12 


3 


11 


3 


14 


3 


2 


2 




4 


4 


8 


11 


11 


11 


5 


m 


1' 


3 


S 


3 


3 


6 


3 


7 


S- 


13 


9 


14 


/ 


n 

a 


r 

0 


10 


5 


4 


10 


8 


2 


14 


2 


7 


14 • 


9 


9 


6 


10 


4 


14 


10 


4 


10 


10' 


2 


7 


10 


13 


7 


11 




4- 


5 


2 






12 




9 


11 


5 






13 




13 


13 








STEP BR 


,618 


".5 73 


. 592 


.587 


, 652 


. 599 


TOTAL R 


.637 


.600 


. 53 3 , 


*61Q 


.682 


,629 
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TABLE 4 

Variables Entered at Each Step 
for -Form 3 of the Test 



STEP 


Grade H 


Grade 5 


T ' 

Grade 6 


1 Grade 7 


Grade 8 


1 TOTAL 


1, 


3 


8 


12 


8 


8 


H 

8 


2 


5 


12 


8 


12 


12 


12 


3 


9 


13 


4 


1 ■ 


13 


1 


4 


1 


9 


2' 


; 13 


11 


13 


5 


5 


3 


14 


11 


9 


9 


6 


11 


10 


9 


5 


1 

1 3 


3 


7 


. 2 


14- 


3 


9 


1 


11 


Q 
Q 


c 


11 


11 


3 


6 


5 


9 


12 


5 


6 


14 


2 


14 


10 


7 


4 


10 


10 


10 


10 


.11 


13 


7 


7 


8- 




8- 


12 


4 


2 


13 


6 . 




2 


13 


14 






13- . 




1- 


14 ' 


10 






7 




8 


IS 








2 




7 


16 












6 . 


STOP 6R 


.657 


.778 


,664 


.72 8 


.699 


. 710 


TOTAL R 


.631 


. 795 . 


. 808 


.80 5 


.730 


,773 
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'TABLE 8 
Variables L'ntered at '£a.ch Step 
for Form 1 of the Test, 
6 Selected Variables 



STEP 


T-" ■ 

Grade U 


Grade 5 


J 

i 

Grade 6 


Grade 7 


Grade o 


TOTAL 


1 


9 


5 


9 


5 


8 


5 


2 




B 


5 


9 


9 


9 • 


3 




3 


B 


3 


14 


3 


4 


8 




12 . 


14 


3 


14 


5 


3 


8 


3 


8 


5 




6 


12 


12 




12 






STEP 4R- 


. i+00 


, 738 


.443 


.578 


. 448 


. 566 


TOTAL R 


.If 18 




,449 


.581 


.465 


.566 
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TABLE 9 

Variables Entered at Each Step 
for Form 2 of the Test, 
6 Selected Variables 



STEP 


Grade 4 


Grade 5 


Grade 6 


Grade 7 


Grade 8 


.TOTAL ^ 


1 


8 


12 


r- 

0 


8 


8 


8 


2 


12 


8 


12 


12 


12 


12 


si 


5, 


5 


' 14 


3 


3 


14 




■ 14 


3 


8 


9 


9 


3 


S 


9 


9 


3 . 


m 


!■+ 


9 


6 


3 




5- 




5 




7 






9 








STEP 4R 


.586 


,546 


.580 


.551 


.544 


.578 


TOTAL R 


,590 


. 551 


.592 


.55 3 


.554 


.589 
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TABLE 10 
Variables Entered at Each Step 
for Forni 3 of the Test 5 
6 Selected Variables 



STEP 


Grade H 


Grade 5 


Grade 6 


Grade 7 


Grade S 


1 TOTAL 
i 


1 


3 


8 


12 


8 


8 . 


.8 


2 


5 


12 


8 


12 


12 


12 


3 


9 


14 


9 


14 


S 


14 


4 


12 


S 


3 


5 


3 


i 


5 


3- 


3 


14 


3 


9 , 


3 


6 


14 ' 


9 






14 


5 


STEP 4R ■ 


. S25 


. 715 


.669 


.686 


.5 75 


.649 


TOTAL R 


.526 


.772 


. 6 73, 


.705 


.661 


.690 


















in 


CD 














• 


1.26 


en 
CO 
* 


00 
£^ 
* 


• 




CO 






















• 














00 




















m 


1^ 




to 




1 






^0 




0 




0 














re 




* 


• 


■ * 




• 




ii 










































a 
























■H 












































fl) 






* 




























0 










a 






Qj 


CM 






CN 




















0 










iw 






U 


# 






• 


• 














1 














CU 






















o 


































































o 






























en 






lD 


TO 


to 




m 










0 


IS 


GD 


to 






m 










CO 




CO 








Q) 






* 




■ 


* 


■ 


• 




U 










iH 












C5 
























u 


















a 




0 














































• 






a 


j 


H 






0 


0) 




cn 












1 




0 




• 




CM 


0 






H 




cfl 








• 








• 


e 


ii 


U 






















0 




0 
















g 




a 






























































> 
















CO 






1 










fH 






CN 








0 








H 




CM 










' m 




■ 






c 




G 








1 




































■p 














































O4 










































0 






















0 


































H 




CM 
















CM 
















• 






■ 




• 




o 














H 




H 


































♦ 














m 






















0) 




















CO 


o 
















































0) ^ 










CD 


to . 




1 
















a 








0 




c 




• 




• 


• 




■ - 


11 




























CO 
















g 






















a) 












































00 






















/ti 










H 


so 


CO 












CO 




CO 






ui 








!■ Co 






0 














• 

j 


■ 


• 

i 


■ 


• 


■ 








0) 




















H 




















































































in 


















> 










H 


H 









0 


to 


H 








m 


• 












• 


0 


















^' 


CM 


fH 




OJ 




rH 




0 




CSj 




u 




• 



Icq 

CD 







^1 




0 


cs 




J- 


0 




CM 


if 






J- 


CO 


■ 


• 


■ 


m 


H 




CM 


rH 



to 

c 

I 

it 

g 



o 
TO 
o 



H 

rH 





0 


CO 




CM 










CM 


00 








to 


rH 


CO 






• 




" m 














rH 


rH 




0 




CM 




to 








cn 




fH 






CM 






csr 


CO 










• 


■ 












0) 


cn 








rH 


0 




H 








a 


m 




• 


• 


• 



1 

ii 

a 



00 












H 


CM 


CM 








H 


ro 


cn 




CM 




■ 






# 




• 


H 


rH 




04 











m 


rH 






cn 








cn 


00 




CSj 








H 


■ 


• 


■ 




• 





CM 

r 

11 

g 



• 


□0 


rH 






H 




0) 


cn 


H 




TO 


H 


a 


Q 


a 


ro 








CM 


Q 


• 
1 


■ 


a 
1 


■ 


• 
1 


• 



V 



cn 



cn 



CM 



24 



m 
c 

a 

•H 

o 

a 











0 






*H 






W 






U) 






Q) 














c 












u 
















Q 








0 




W 






P^ 






fS 
w 


£/) 




£^ 


0) 


H 


U 






y 












-a 


> 


PQ 


Si 




< 














c 


















CO 














a 




to 


3 




+j 


a 










0) 












g 






•H 






M-4 






Mn 






0) 






O 






u 






d 






o 






'H 






W 












■ 












bo 

















ERIC 



o 

































CD 







O I CD 
1 



o 




in 








CO 


o 












• 


■ 


■ 








H 










<N 


to 


cn 






o 






. * 


' • 


* 


■ 




o 








rH 








O 


O 




c 






• 



01 



6 
a 



0) 
H 

•N 
U 

m 



CSi 
















CN 








Ml 




ts 


m 














rH 






CN 






CN 




un 






01 


Ml 




CN 






CD 


• 




• 




• 






CO 




o 


ri 


















o 


- « 


# 




p 





m 

CO 

^. 

i 

a 



CP 

I 

li 

g 











CN 




CD 




o 


to 






CN 


ni 














• 


■ 







• 1 






^- 


€0 


ri 


QO 




Ml 






CO 






« 1 




CN 


O 


o 


O 


CN 








# 


• 




• 



• 1 

MH 






CN 


CN 


CN 


to 


(D 


H 


01 




CO 




H 




■O 
• 
1 


Q 
1 


• 


• 


• 


H 
• 

1 



CN 



H 
I 

□ 



01 



0) 

0 

CJ 



o 



O 

a 



H 











Ml 


£^ 


CD 




m 


Ml 




o 


tfl 




CD 


• 


• 










CN 










o 




to 


rH 


fn 










o 












9 ' 








H 


o 




CI 


CN 




^- 




en 












iH 


• 






■ 





o 


CN 


so 




cn 


rH 


H 


un 


to 


M^ 




cn 


ri 










in 




- m 


- s 




• 


, t' 


H 




H 








CN 


fn 


rH 


ri 


Ml 


H 




eg 


CI 


^^ 




Cl 




CN 


a 


CP 




H 












• 


Ml 




rH 






CN 


M? 




CD 








o 


o 


O 






rH 


. m 


. . . • 











H 





to 




o 






ni 








SO 




• 


■ 


■ 




H 













! m 


















• 








CD 















CN 






o 








CN 








i 



a 



so 



to 

H 



W7 










cn 






CO 


Ml 








G 


o 


• 




■ 


m 





03 



CN 
H 



■J 
fH 



